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A  NON-VERBAL  TECHNIQUE  FOR  THE  ASSESSMENT  OF  GENERAL 
INTELLECTUAL  ABILITY  IN  SELECTION  OF  AVIATION  PERSONNEL 


I.  Introduction. 

Present  selection  procedures  which  test  for 
ability  to  successfully  complete  training  in  many 
skilled  aviation  professions,  such  as  air  traffic 
control,  give  heavy  weight  to  verbal  skills.  Per¬ 
formance  on  the  selection  task  may  therefore 
depend  in  large  part  upon  the  degree  to  which 
an  individual  has  a  history  of  language  experi¬ 
ences  appropriate  to  the  verbal  aspects  of  the 
assessment  devices  employed.  Thus,  selection 
procedures  which  include  predominantly  verbal 
components  may  discriminate  against  individuals 
with  otherwise  adequate  abilities.  Such  discrimi¬ 
nation  is  most  likely  to  influence  the  i>erformance 
of  cultural  minorities,  since  their  language  ex¬ 
periences  may  be  markedly  different  from  the 
experiences  of  most  of  the  individuals  used  to 
standardize  selection  devices.**  - T  Therefore, 
there  is  a  need  for  a  measure  of  job-relevant 
intellectual  abilities  which  is  not  dependent  on 
specific  acquired  verbal  skills. 

A  device  which  may  have  some  promise  in  this 
regard  is  the  “code-lock”  problem-solving  task. 
The  device  was  originally  developed  as  part  of 
a  group  problem-solving  program  for  use  in 
assessing  air-crew  performance,*  and  was  subse¬ 
quently  modified  for  use  with  individuals.  It 
requires  a  subject  to  determine  the  correct  se¬ 
quence  for  pressing  push-buttons  by  using  a 
specified  sea re'i  sequence.  A  modified  version  of 
the  code-lock  task,  called  COTRAX,  was  used 
by  Alluisi  and  Coates1  to  test  the  relationship 
between  this  general  type  of  procedure  and 
various  measures  of  intelligence  and  achievement. 
The  COTRAX  procedure  is  considerably  more 
complex  than  the  code-lock  task,  as  it  consists  of 
three  phases.  Phase  one  is  a  standard  code-lock 
problem,  phase  two  is  a  second  standard  code¬ 
lock  problem  whose  solution  is  a  transform  of 
the  first  problem,  and  phase  three  is  a  code-lock 
problem  which  is  to  l>o  solved  by  application  of 
I  he  transformation  rule  rather  than  through  the 


search  sequence.  Alluisi  and  Coates  found  that 
some  COTI? AX  measures  established  by  factor 
analytic  procedures  correlated  up  to  ,;V2  with  the. 
Raven  Progressive.  Matrices  Test  (RPMT),  a 
non-verbal  intelligence  assessment  technique,  and 
to  .30  with  the.  Quantitative  and  Total  scores  of 
the  Scholastic  Aptitude  Test  (SAT).  However, 
the  pattern  of  correlations  in  their  study  sug¬ 
gested  that,  the  standard  code-lock  portions  of 
COTRAX  (phases  1  and  2)  might  be  as  closely 
related  to  the  RPMT  as  measures  from  the  entire 
COTRAX  task.  One  purpose  of  the  present, 
study  was  to  examine  this  possibility  by  testing 
subjects  on  the  code-lock  procedure  alone,  and 
comparing  their  ]>erformancc  to  their  scores  on 
the  RPMT. 

A  second  interest  of  this  study  was  to  deter¬ 
mine  to  what  extent  i>erformanee  on  the  code- 
lock  task  might  lxs  related  to  more  general 
measures  of  intelligence  than  the  RPMT.  One 
of  the  limitations  of  the  RPMT  is  that  it  lias 
l)een  found  to  have  a  limited  relationship  to 
performance  in  most  academic  or  occupational 
settings.5  If  the  code-lock  task  is  also  found  to 
be  related  to  general,  as  well  as  to  non-verbal, 
intellectual  ability,  then  its  value  for  use  in  selec¬ 
tion  batteries  would  !>e  much  enhanced.  In  this 
case,  the  measure  of  intelligence  chosen  was  the 
Otis  Quick-Scoring  Mental  Ability  Test  since  it, 
is  brief,  easily  administered,  often  used  in  scho¬ 
lastic  placement,  and  is  reasonably  correlated 
with  other  tests  of  intelligence.*  *  - r- 

The  third  concern  of  this  experiment  was  to 
study  the  effects  of  problem  difficulty  upon  the 
relationship  l»ctween  code-lock  and  intelligence 
test  performance.  The  measure  of  difficulty  em¬ 
ployed  was  the  complexity  of  each  code-lock 
problem,  defined  as  the  numl>er  of  button  presses 
required  by  the  search  sequence  to  determine  the 
correct,  problem  solution.  In  other  words,  a 
problem  solution  which  matched  the  search  se¬ 
quence  exactly  would  be  of  lowest  difficulty,  while 
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tin*  more  the  correct  sequence  departed  from  the 
search  sequence,  the  more  difficult  the  problem. 

ri.  Method. 

S ir /)/!’/■  fs.  The  subjects  for  this  experiment 

were  15  paid  male  volunteers  recruited  from 

a moii"  the  students  of  the  I'niversitv  of  Okla- 
>  * 

hmna  part-time  employment  pool. 

I't'rfoi'inaii'  t'  Taxi,'  A/t/anafax.  The  apparatus 
for  the  task  consisted  of  a  peripheral  modifica¬ 
tion  of  the  "roup  problem-solving  task.’-  The 
modification  comprised  the  substitution  of  a 
small  metal  box  on  which  five  push-buttons  were 
mounted  in  a  row  for  the  single  button  i»er  each 
of  five  subject  panels  in  the  "roup  version. 

Three  indicator  lights,  with  green,  anilter,  or 
red  jewels,  provided  feedback  to  the  subject. 
The  "teen  light  was  used  to  indicate  that  a  given 
problem  had  lieen  solved.  The  amlter  light  indi¬ 
cated  to  the  subject  that  his  depression  of  one 
of  the  buttons  had  registered  in  the  programming 
and  scoring  circuitry  (  failure  of  this  light  to 
illuminate  was  a  signal  to  repress  the  button  to 
register  the  response  choice).  The  ml  light 
served  two  functions.  Its  initial  illumination 
indicated  to  the  subject  that  a  problem  was  lieing 
presented  and  that  he  should  immediately  begin 
to  search  for  the  solution.  Subsequently,  the  red 
light  provided  error  information  in  the  following 
manner:  any  time  any  of  the  buttons  was  pushed 
while  the  red  light  was  on,  the  light  would  go 
out.  If  the  button  depressed  was  the  correct  first 
button  in  a  given  problem  sequence,  the  light 
would  remain  out  when  the  button  was  released: 
if  the  button  was  incorrect,  the  ml  light  would 
come  back  on  when  the  button  was  released. 
Thus,  the  initial  step  in  solving  a  problem  was 
to  try  the  buttons  one  at  a  time  in  a  left-to-right 
sequence  to  determine  which  button  was  first  for 
solving  the  problem  at  hand.  Having  found  that 
button,  the  subject  again  searched  in  a  left-to- 
right  sequence  for  the  next  correct  button.  Thus, 
if  the  next  button  pushed  after  finding  the  first 
correct  button  was  the  second  in  the  sequence, 
the  red  light  would  stay  out:  if  the  next  button 
was  out  of  sequence  for  that  problem,  the  red 
light  would  be  re-illuminated,  and  the  numlier- 
one  button  would  again  have  to  be  pushed  in 
order  to  continue  with  the  search  for  the  second 
button.  Once  each  of  the  five  buttons  had  lieen 
pushed  in  the  correct  sequence,  the  green  light 


would  be  illuminated  signifying  that  the  problem 
had  lieen  solved.  After  a  ten-second  delay,  the 
same  problem  would  lie  presented  a  second  time, 
thus  requiring  the  subject  to  remember  the  se¬ 
quence  during  the  inter-problem  interval.  Thus, 
each  problem  was  solved  twice,  once  by  searching 
for  tho  answer  and  once  by  re-entering  the  al¬ 
ready  obtained  answer.  Subjects  wore  required 
to  make  all  responses  with  tho  index  finger  of 
the.  right  hand. 

The  24  problem  sequences  selected  from  the  52 
possible  sequences  were  presented  in  a  random¬ 
ized  order  so  that  the  subject  had  no  prior  in¬ 
formation  as  to  the  correct  sequence  for  any 
given  new  problem. 

The  left-to-right  search  procedure  sjiecified  to 
the  subjects  was  chosen  as  the  most  efficient  ap¬ 
proach  in  terms  of  memory  load  during  search. 
Therefore,  subjects  were  instructed  always  to  lie- 
gin  with  the  left-hand  button  and  search  from 
left  to  right;  the  left-hand  button  was  to  be 
considered  to  follow  the  extreme  right-hand  but¬ 
ton  in  the  search  sequence.  For  example,  assume 
the  correct  sequence  for  a  given  problem  to  be 
button  depressions  in  the  order  4,  5,  3,  1,  2.  A 
subject  who  was  proceeding  according  to  instruc¬ 
tions  would  emit  the  following  responses  (“E” 
designating  an  error  and  “R"  a  correct  response) : 
IE,  2E,  3E,  4R,  5R,  IE,  4R,  5R,  2E,  4R,  5R,  3R, 
1R,  2R  (green  light). 

The  subject's  performance  was  recorded  by 
means  of  an  automatic  scoring  system  with  a 
punch  tape  output.  The  time  at  which  each 
event  occurred  was  recorded  to  the  nearest  1/100 
second  with  respect  to  the  beginning  of  the  ex- 
[Kvimental  session  (time  zero).  The  button 
pushed,  whether  or  not  it  was  in  the  correct  se¬ 
quence,  and  whether  it  was  associated  with  an 
initial  solution  or  a  re-entered  solution  was  also 
recorded.  Tho  punch  tapes  were  then  read  by  a 
computer  which  complied  and  analyzed  the  data. 
The  measures  used  were  as  follows: 

1.  Mean  time  per  response  (initial  and  re¬ 
entered  solution  combined).  This  measure  simply 
determined  the  average  number  of  seconds  it 
took  a  subject  to  make  each  one  of  his  responses 
during  the  entire  course  of  the  experiment.  It 
provides  an  index  of  the  speed  with  which  eacli 
subject  responded. 

2.  Mean  surplus  errors  (initial  solution).  The 
surplus-errors  measure  was  derived  as  follows: 
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for  any  driven  problem  sequence,  the  exact  num¬ 
ber  of  errors  could  be  predicted  for  a  subject 
who  followed  the  prescribed  search  procedure. 
Thus,  this  measure  was  the  mean  (per  problem) 
of  the  actual  number  of  errors  minus  the  ex¬ 
pected  number  of  errors  for  the  initial  solution 
of  the  problems.  For  example,  referring  back 
to  the  previously  presented  sample  problem  se¬ 
quence,  the  expected  *  uml>cr  of  errors  in  solving 
I  hat  problem  was  live. 

3.  Proportion  of  errors  (initial  and  re-entered 
solution  combined).  This  represents  the  nmnlter 
of  errors  a  subject  made  divided  by  the  entire 
number  of  responses  made  to  the  problem.  In 
other  words,  it  is  a  measure  of  one  aspect  of 
I )  rol  >1  cm  -sol  vi  ng  eflic  ienev . 

4.  Mean  time  |>er  response  (re-entered  solu¬ 
tion).  This  value  is  calculated  only  for  the 
responses  during  the  confirming  solution  triui, 
and  provides  a  measure  of  response  speed  after 
the  various  problems  had  been  solved. 

5.  Mean  solution  time  after  first  correct  re¬ 
sponse  (initial  solution).  In  this  case,  the  meas¬ 
ure  indicates  bow  long  it  took  a  subject  to 
determine  the  correct  solution  to  a  problem  once 
be  had  found  the  button  which  started  the  correct 
pressing  sequence. 

The  problem  difficulty  was  controlled  after  the 
fact.  One  problem  could  l»c  solved  with  only  one 
error;  one  problem  could  be  solved  with  nine 
errors,  the  maximum  number  of  errors  for  any 
of  the  problems.  For  the  difficulty  analysis,  the 
24  problems  were  divided  into  three  sul>sets  with 
the  following  ranges  of  expected  numbers  of 
errors :  1  to  4,  f>  to  G,  and  T  to  9 ;  the  numl>er  of 
problems  falling  in  each  of  (lie  three  categories 
was  8, 9,  and  7  respectively. 

Intelligence  Measurement.  The  Otis  Quick- 
Scoring  Mental  Ability  Gamma  Test,  Form  C, 
was  administered  using  the  standard  instructions 
from  the  manual  with  a  30-minute  time  limit. 
The  Raven  Progressive  Matrices  Test  (19G2 
Revision)  was  also  given  with  the  standard  in¬ 
structions  and  a  40-minute  time  limit.  (Brief 
descriptions  of  the  Otis  and  RPMT  are  pre¬ 
sented  in  Appendix  1.)  For  20  of  the  subjects, 
the  Otis  was  given  first,  the  code-lock  perform¬ 
ance  second,  and  the  RPMT  last.  For  the  other 
22  subjects,  the  order  was  reversed. 

Procedure.  The  subject,  upon  arrival  at  the 
laboratory,  was  given  the  paper-and-pencil  test 


that,  bad  been  chosen  at  random  for  him  to  take 
first.  After  finishing  that  test,  or  upon  expira¬ 
tion  of  the  time  limit,  the  subject  liegnn  the 
training  period  on  the  code-lock  task.  lie  was 
told  to  push  only  one  button  at  a  time  using  the 
index  finger  of  his  right  hand.  He  was  told  to 
work  as  rapidly  as  he  could  but  to  avoid  making 
unnecessary  errors.  The  experimenter  “talked 
the  subject  through"  two  complete  problems  and 
then  stood  Itehind  the  subject  for  a  number  of 
problems  that  was  dejtendent  upon  when  the 
subject  bad  demonstrated  that  be  understood  the 
nature  of  the  task  and  what  was  expected  of  him 
(this  nmnlter  was  typically  altout  three  prob¬ 
lems).  The.  experimenter  then  entered  the  ad¬ 
joining  room  from  which  he  could  observe  the 
subject  through  a  half-silvered  mirror.  The 
subject  was  jtermitted  to  work  a  total  of  at.  least 
ten  practice,  problems:  when  required  the  nmnlter 
was  extended  to  11  or  12.  When  necessary  dur¬ 
ing  the  training  phase,  the  exjterimenter  reminded 
the  subject  to  follow  the  prescrilted  search  se¬ 
quence.  Xo  interaction  with  the  subject  was 
carried  out  during  the  test  session  itself.  The. 
duration  of  the  test  session  depended  on  how  fast 
the  subject  worked  the  24  problems,  both  initial 
and  second  solutions:  the  mean  for  the  45  sub¬ 
jects  was  25.37  minutes  with  a  standard  deviation 
of  2.10  minutes.  (This  mean  included  7.83  min¬ 
utes  which  was  the  sum  of  the  fixed  between- 
problem  times.)  The  subject  then  took  the, 
remaining  paper-and-pencil  test. 

III.  Results. 

Intelligence  Measure*.  The  obtained  distribu¬ 
tion  of  scores  on  the  RPMT  (Table  1)  ranged 
from  14  to  35  with  a  mean  of  24.9  and  a 
standard  deviation  of  4.G.  A  score  of  14  on 
this  test  represents  the  75th  percentile  according 
to  the  published  norms  for  age  20.  The,  90th 
percentile  and  95th  percentile  are  represented  by 
scores  of  21  and  24  respectively.  In  this  study, 
30  of  the  subjects  (80^4)  scored  at  the  90th 
percentile,  or  above.  Thus,  the  range  of  RPMT* 
scores  was  rather  limited. 

The  scores  on  the  Otis  ranged  from  43  to  7G 
with  a  mean  of  Gl.G  and  a  standard  deviation  of 
0.2  (Table  1).  The  mean  for  the  Otis  at  age  18 
or  older  is  42.  Since  a  Gamma  IQ  of  100  is  the 
equivalent  of  the  50th  percentile,  the  range  of 
obtained  IQ  scores  (from  101  to  134)  represents 
a  variation  from  average  to  superior  perform  - 
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Table  1 . — Frequency  distribution  of  scorns  on  the  Raven  Progressive  Matrices  Test  (1962  Revision)  and  Otis  Quick- 

Scoring  Mental  Ability  Gamma  Test,  Form  C. 


RPMT 

Otis 

Score 

N 

Score 

N 

Score 

N 

Score 

N 

Score 

N 

14 

l 

25 

o 

43 

1 

54 

1 

65 

1 

15 

1 

26 

4 

44 

1 

55 

2 

66 

4 

16 

— 

27 

1 

45 

— 

56 

1 

67 

1 

17 

1 

28 

4 

46 

— 

57 

1 

68 

2 

18 

1 

29 

1 

47 

1 

58 

3 

69 

3 

19 

3 

30 

5 

48 

2 

59 

2 

70 

1 

20 

2 

31 

2 

49 

1 

60 

1 

71 

1 

21 

— 

32 

i 

50 

1 

61 

— 

72 

— 

22 

4 

33 

— 

51 

— 

62 

2 

73 

1 

23 

3 

34 

— 

52 

1 

63 

1 

74 

2 

24 

5 

35 

i 

53 

o 

64 

1 

75 

1 

76  3 


n nee.  This  was  a  considerably  greater  range  of 
scores  than  that  obtained  from  the  RPMT. 

The  correlation  between  the  RPMT  and  the 
Otis  was  .27  ( .0~> < /j < .  10 ) . 

Code- Lock  Performance  ant!  Intelligence.  The 
intercorrelational  matrix  of  the  five  code-lock 
measures  and  the  two  intelligence  measures  is 
shown  in  Table  2.  These  correlations  are  based 
on  averages  across  all  difficulty  levels  for  the 
code-lock  measures. 

Only  one  of  the  five  correlations  between  the 
code-lock  measures  and  the  RPMT  was  signifb 
cant  at  the  .03  level  of  confidence.  This  was  the 
measure  of  time  required  to  solve  the  problem 
a  fter  having  found  the  first  correct  button  in  a 
problem  sequence  (r— —  .31).  The  correlation 


lietween  the  actual  number  of  errors  minus  the 
expected  number  of  errors  approached,  but  did 
not  achieve,  significance,  (»•=— .29;  ,05</><.10). 

The  correlations  for  each  RPMT  measure  with 
each  of  the  three  levels  of  expected  errors  are 
shown  in  Table  3  for  the  RPMT.  The  smaller 
predicted  number  of  errors  led  to  higher  correla¬ 
tions.  Four  of  the  five  correlations  were  signifi¬ 
cant  at  the  .05  level  of  confidence  for  the  expected 
error  range  of  1  to  4  errors;  the  fifth  correlation 
approached  significance  (»•=—  .29;  .05</><.10). 
None  of  the  correlations  for  either  the  5  to  6  or 
the  7  to  9  error  ranges  was  significant. 

Three  of  the  five  correlations  between  the  Otis 
and  the  code-lock  measures  were  significant. 
These  code-lock  measures  were :  time  per  response 


Table  2. — Correlation  matrix  for  intelligence  and  codc-lock  measures. 


Measure” 


Raven  Mi  Mj  Mj  M«  Ms 


Otis . 274  -.613**  -.196  -.245  -.594**  -.574** 

Raven .  -.246  -.293  -.182  -.178  -.311* 

M‘ .  .204  .246  .832**  .962** 

M* .  .597**  .136  .373** 

M* .  .424**  .276 

M4 .  .705** 


“M1 — Mean  time  per  response  (1st  and  2nd  solutions  combined) 
M* — Mean  surplus  errors  (1st  solution) 

M* — Proportion  of  errors  (1st  and  2nd  solutions  combined) 

M* — Moan  time  per  response  (2nd  solution) 

M* — Mean  solution  time  after  1st  correct  response  (1st  solution) 
*— p<.05  **=p  <.Q1 
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Table  3. — Correlations  between  code-lock  measures  for  three  levels  of  expected  errors  (problem  difficulty)  and  both  the 
Raven  Progressive  Matrices  Test  and  the  Otis  Quick-Scoring  Mental  Ability  Gamma  Test,  Form  C. 


Test 

Measure  8 

Expected 

Errors 

Mi 

Mi 

Ms 

M< 

Ms 

1-4 

-.332* 

-.354* 

-.298 

-.304* 

-.397** 

Rave  i . 

5-G 

-.154 

-.058 

-.085 

-.059 

-.270 

7-9 

-.260 

-.023 

-.048 

-.172 

-.268 

1-4 

-.565** 

-.106 

-.168 

-.500** 

-.488** 

Otis . . . . 

5-6 

-.586** 

-.132 

-.185 

- . 494** 

-.551** 

7-9 

- . 590** 

-.117 

-.010 

-.516** 

— . 522** 

8  Sec  Table  2  for  description  of  measures 
*—p  < .  05  **=p<.01 

for  first  and  second  solutions  combined  (r=.61), 
time  per  response  for  the  second  solution  only 
(r=—  .59),  and  solution  time  after  finding  the 
first  correct  button  in  the  sequence  (r=—  .57). 
The  intercorrelations  among  the  three  code-lock 
measures  that  correlated  significantly  with  the 
Otis  were  quite  high,  ranging  from  +.70  to  +.96. 

The  correlations  with  the  Otis  for  each  measure 
at  each  of  the  three  levels  of  expected  errors  are 
shown  in  Table  3.  The  relative  magnitudes  of 
the  correlations  were  not  appreciably  affected  by 
the  breakout  of  different  expected  numbers  of 
errors.  However,  the  correlations  were  slightly 
lower  than  for  the  data  based  on  all  problems, 
perhaps  because  of  the  decreased  stability  afforded 
by  the  smaller  number  of  problems  per  data 
point  for  each  subject  for  a  given  expected  error 
range. 

IV.  Discussion. 

The  small,  non-significant  correlations  (.27) 
between  the  Otis  and  the  RPMT  is  consistent 
with  previous  research  findings."*  - 8  On  the 
other  hand,  it  is  probable  that  such  correlations 
indicate  that  the  two  tests  do  not  generally 
measure  the  same  aspects  of  mental  abilities. 
Also,  in  this  study  the  range  of  scores  on  the 
RPMT  was  rather  narrow,  which  may  have  fur¬ 
ther  limit  :d  the  RPMT-Otis  correlations  as  well 
as  the  RPMT  and  code-lock  correlations.  The 
finding  that  the  RPMT  scores  were  uniformly 
at  a  high  level  was  not  expected  since  the  1902 
revision  of  the  RPMT  was  developed  to  provide 
a  non-verbal  assessment  of  ability  in  adults  of 
above-average  intellectual  ability/  Instead,  the 


present  findings  suggest  that  the  1962  version  of 
the  RPMT  also  has  a  relatively  low  functional 
“top,"  at  least  when  applied  to  college  student 
populations  and  may,  therefore,  not  be  appro¬ 
priate  for  use  with  individuals  of  above  average 
intelligence. 

In  general  the  code-lock  measures  did  not  re¬ 
late  closely  to  RPMT  performance,  except  at  the 
least  difficult  problem  level.  However,  even  with 
the  least  difficult  problems  the  correlations,  al¬ 
though  significant  for  the  three  time  measures 
and  one  error  measure,  did  not  exceed  .40.  In 
comparison,  Alluisi  and  Coates’  found  correla¬ 
tions  ranging  to  .52.  As  noted  above,  the  gen¬ 
eral  lack  of  a  strong  relationship  in  this  study 
may  have  been  due  in  large  part  to  the  limited 
range  of  RPMT  scores.  In  the  Alluisi  and 
Coates  experiment,  the  range  of  RPMT  scores 
was  considerably  greater,  as  according  to  Coates,4 
only  40 %  of  their  subjects  exceeded  the  90th 
percentile,  while  in  this  study  80%  exceeded  that 
level  of  performance.  It  is  particularly  puzzling, 
however,  as  to  why  the  significant  correlations 
were  obtained  only  for  the  least  difficult  prob¬ 
lems.  Perhaps  the  differentiation  which  did 
occur  in  RPMT  scores  was  related  in  some  man¬ 
ner  to  the  subjects'  ability  to  estimate  an  entire 
sequence  for  the  least  difficult  problems  from  a 
few  button  presses,  while  this  was  not  possible 
for  any  subjects  with  the  more  complex  response 
sequences. 

In  comparing  this  study  with  that  of  Alluisi 
and  Coates,’  the  procedural  variations  between 
the  code-lock  and  COTRAX  tasks  should  also 
be  noted.  First,  the  instructions  given  COTRAX 


subjects  did  not  mention  speed  or  accuracy  dur¬ 
ing  the  two  phases  consisting  of  code-lock  prob¬ 
lems.  In  this  study,  each  subject  was  told  to 
respond  as  rapidly  and  as  accurately  as  he  could. 
Second,  the  response  keys  (not  buttons)  for  the 
COTRAX  task  were  arranged  for  convenient 
operation  by  the  fingers  and  tlumtb  of  the  right 
hand,  while  subjects  used  only  the  right  hand 
index  linger  in  this  experiment.  The  emphasis 
on  speed  and  accuracy  in  this  setting  may  have 
.increased  the  intellectual  demand  upon  the  sub¬ 
ject  considerably  from  that  in  the  COTRAX 
task,  and  the  difference  in  response  devices  may 
have  increased  the  influence  of  manual-dexterity 
in  the  COTRAX  findings.  How  these  factors 
relate  to  the  relative  performance  on  the  intelli¬ 
gence  measures  is  not  clear. 

With  respect  to  the  Otis,  it  was  found  that  the 
three  time  measures  were  reasonably  efficient 
predictors  of  Otis  performance  at  all  three  diffi¬ 
culty  levels.  It  is  noteworthy  that  the  magnitude 
of  these  correlations  approached  those  usually 
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obtained  when  the  Otis  is  compared  with  other 
measures  of  intelligence  an«  achievement.3  It  is 
not  clear  .vhy  the  Otis  should  correlate  only  with 
time,  and  not  error,  meu  sipes.  Perhaps  the  fact 
that  the  Otis  is  administered  under  a  time  limit 
is  important  to  the  relationship.  The  RPMT, 
which  was  also  administered  as  a  speed,  rather 
than  power,  device  showed  some  similar  trends 
where  significant  correlations  occurred,  and  thus 
is  consistent  with  the  (Jtis  findings  in  indicating 
the  significance  of  thettime  factor  as  a  basis  for 
the  obtained  relationships.  In  any  e\lent,  the 
code-lock  task  does  sdim  related  to  the  Otis  as  a 
measure  of  general  intelligence,  arid  therefore 
may  offer  some  promise  as  an  assessment  device 
which  does  not  require  highly  .developed  verbal 
skills.  If  so,  it  would  have1  potential  utility  in 
the  assessment  of  ability  to  learn  where  orthodox 
evaluation  techniques  discriminate  against  indi¬ 
viduals  whose  experiences  have  not  encotfraged 
the  development  of  the  specific  language  facilities 
needed  for  successful  test  performance.  i 
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APPENDIX  I 

Intelligence  Measure  Description 


Otis  Quick-Scoring  Mental  Ability  Gamma  Test, 

C 

Ti.'s  test  is  a  revision  of  one  of  the  first  devices 
to  be  used  for  the  assessment  of  the  intelligence 
levels  of  individuals  examined  in  groups.  The 
particular  form  employed  is  suitable  for  use  with 
persons  who  have  at  least  reached  high  school 
ago.  The  80  items  sample  such  areas  as  vocab¬ 
ulary,  quantitative  reasoning,  perception  of  spa¬ 
tial  relationships,  and  abstract  reasoning.  The 
test  is  not  so  sophisticated  as  some  more  recently 
developed  intelligence  assessment  techniques; 
however,  its  predictive  validity  for  academic 
achievement  has  been  shown  to  compare  favor¬ 
ably  with  most  other  tests.  It  is  easy  to  both 
administer  and  score,  and  is  especially  useful  in 
situations  where  time  for  assessment,  is  limited. 

Havens  Progressive  Matrices  Test  (19G2  Revi¬ 
sion) 

The  RPMT  was  developed  as  a  device  to  meas¬ 
ure  intelligence  independently  of  an  individual’s 
level  of  verbal  skill.  Although  widely  used  in 


England,  this  technique  has  had  limited  appli¬ 
cation  in  the  United  States  because  it  has  lacked 
suitable  norms  and  has  not  been  found  to  cor¬ 
relate  highly  with  academic  performance.  It  has 
been  used  primarily  as  a  means  of  identifying 
individuals  with  good  reasoning  ability  who  have 
poor  reading  or  language  development.  The 
items  employed  in  the  RPMT  are  essentially  two- 
dimensional  analogy  problems.  For  each  prob¬ 
lem,  a  matrix  of  eight  patterns  in  a  three-row 
by  three-column  arrangement  is  presented  the 
subject.  The  subject  then  attempts  to  choose  the 
correct  pattern  from  several  alternatives  to  com¬ 
plete  the  ninth  position  in  the  matrix.  This  re¬ 
quires  the  determination  of  two  principles,  one 
which  governs  the  transition  in  patterns  across 
rows,  and  one  which  determines  the  variation 
down  columns.  The  two  principles  can  then  be 
applied  to  the  available  alternatives  io  determine 
the  correct  choice  for  the  final  pattern.  The 
version  of  the  RPMT  used  in  this  experiment  is 
the  Advanced  Set  which  is  suitable  for  use  with 
adults. 
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